Image And Quick Art Response Code System

ABSTRACT

Disclosed herein are methods of using an augmented reality trigger to locate and/or read a Data Code in an image. A method according to this disclosure may include the step of using an augmented reality trigger in an image to initiate an augmented reality experience, locating portions of Data Code arrange in a plurality of locations within the image, and combining each of the Data Code portions for processing as a unified Data Code. The augmented reality trigger may be stored in a data set including location information to locate each of the Data Code portions. The data set may include information to combine the plurality of Data Code portions.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.17/011,195, filed Sep. 3, 2020, which claims the benefit of the filingdate of U.S. Provisional Application No. 62/896,810 filed Sep. 6, 2019,the disclosures of which are hereby incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to a method of reading Data Code in animage using an augmented reality experience. The method may use apattern generated by an augmented reality experience to locate and readData Code.

BACKGROUND OF THE INVENTION

As used herein, “Data Code” shall mean a linear barcode, a matrix codeor a two-dimensional machine readable codes such as bar codes, QuickResponse (“QR”) codes and Data Matrix codes. Data Code can includecustomized linear barcode and customized matrix code. Linear barcodescan include any one-dimensional code, and matrix barcodes can includeany two-dimensional code. These codes contain data, which can bepositioned or embedded within a base image. The Data Code can then bescanned by a suitable device such as a smartphone, tablet computer,custom reader device to be decoded and data within the Data Code canthen be extracted and processed. As a practical matter, Data Code mayinclude data used as a locator, identifier, or a tracker. The data mayinclude any data that is used in linear barcodes, QR codes, Data Matrixcodes, including an address or pointer to a website, application,product serial codes, product serial codes, product package date,product expiration date and other data.

Data Code can be concealed within the base image to minimize detectionby a viewer in order to maintain the aesthetics of the base image. Ingeneral, large data sets will require large amounts of code. However,such large amounts of code is typically difficult to blend and concealwithin an image, which is then printed on a package or a product.Further, detection and scanning of large amount of data embedded in abase image will require increased time and processing resources to runcomplex algorithms to detect and decode such data.

Therefore, there exists a need for an improved system and method tostore large amounts of data within a base image, and to efficientlyretrieve the data.

BRIEF SUMMARY OF THE INVENTION

Disclosed herein are systems including an image with an augmentedreality trigger and Data Code, and methods for locating and the readingsuch Data Code in the image using an augmented reality experience.

In a first aspect of the present disclosure, a method of using anaugmented reality trigger to read a Data Code in an image is provided. Amethod according to this aspect may include the steps using an augmentedreality trigger in an image to initiate an augmented reality experience,locating portions of Data Code arrange in a plurality of locationswithin the image, and combining each of the Data Code portions forprocessing as a unified Data Code. The Data Code may be located throughprocessing of information generated by the augmented reality trigger.

In accordance with this first aspect, the augmented reality experiencemay be stored in a data set including location information to locateeach of the Data Code portions. The data set may include information tocombine the plurality of Data Code portions.

Further in accordance with this first aspect, the Data Code may be alinear code.

Further in accordance with this first aspect, the Data Code may be amatrix code. The matrix code may be any of QR code and data matrix.

Further in accordance with this first aspect, each of the Data Codeportions may be components of a composite Data Code.

Further in accordance with this first aspect, each of the Data Codeportions may be an independent Data Code.

Further in accordance with this first aspect, each of the Data Codeparts may be sized, shaped and/or colored to blend into the image tominimize visual identification of the Data Code parts by a viewer.

Further in accordance with this first aspect, the augmented realityexperience may include general information about a product line. TheData Code may include product-specific information of a product from theproduct line.

Further in accordance with this first aspect, the augmented realitytrigger may include a grid pattern information used to locate the DataCode.

Further in accordance with this first aspect, the method may includeplacing a device in a first location to locate the augmented realitytrigger, initiating the augmented reality experience, locating each ofthe Data Code portions, combining the Data Code portions, and processingthe Data Code while the device remains in the first location.

In a second aspect of the present disclosure, a method of using anaugmented reality trigger to locate a Data Code within an image isprovided. A method according to this aspect may include the steps oflocating Data Code in an image, using an augmented reality triggerwithin the image to initiate an augmented reality experience, andprocessing the Data Code. The augmented reality experience may include alocation information of the Data Code.

In accordance with this second aspect, the augmented reality experiencemay be stored in a data set. The data set may be stored on a device suchas smartphone, tablet computer or any other augmented reality enableddevice. The data set may be stored in a cloud-based storage system. Thedata set may include location information to locate the Data Code in theimage.

Further in accordance with this second aspect, the Data Code may be alinear code.

Further in accordance with this second aspect, the Data Code may be amatrix code.

Further in accordance with this second aspect, the Data Code may besized, shaped and/or colored to blend into the image to minimize visualidentification of the Data Code by a viewer.

Further in accordance with this second aspect, the pattern may be a gridgenerated by the augmented reality trigger.

In a third aspect of the present disclosure, a method of locating a DataCode in an image is provided. A method according to this aspect mayinclude the steps of generating a grid pattern on an image, breakingdown a Data Code into a plurality of Data Code parts, and placing theplurality of Data Code parts on the image. The grid pattern may begenerated on the image by using an augmented reality experienceinitiated by an augmented reality trigger. Each of the Data Code partsmay be located with reference to the grid pattern such that the DataCode can be located and read by initiating the augmented realityexperience.

In a fourth aspect of the present disclosure, an image with an augmentedreality trigger and one or more Data Codes is provided. An imageaccording to this aspect may include an augmented reality trigger and aData Code comprising of a plurality of Data Code parts. The augmentedreality trigger may be configured to initiate an augmented realityexperience. The Data Code parts may be located in the image withreference to a grid generated by the augmented reality experience. Thedata set may include location information of the plurality of Data Codeparts to allow a device to locate and combine the plurality of the DataCode parts and read the Data Code. The image may be a design, logo,picture or any other representation. The augmented reality trigger maybe sub image configured to blend within the image to minimize visualidentification of the augmented reality trigger. The augmented realitytrigger sub image may be sized, shaped and/or colored to blend into theimage. The plurality of Data Code parts may be sub images configured toblend within the image to minimize visual identification of theplurality of Data Code parts. The plurality of Data Code sub image maybe sized, shaped and/or colored to blend into the image. The device maybe an augmented reality enable device such as a smartphone, tabletcomputer, augmented reality glasses, etc.

In a fifth aspect of the present disclosure, a system including animage, an augmented reality trigger and a Data Code is provided. Asystem according to this embodiment may include an image with augmentedreality trigger and a Data Code, a data set containing the augmentedreality experience and location information of the Data Code. The imagemay be a picture, design, logo, symbol, icon, graphic mark, etc. TheData Code may be located with reference to a grid generated by theaugmented reality experience. The data set may be stored in acloud-based storage system.

In accordance with this fifth aspect, the system may include anaugmented reality enabled device. The augmented reality device may beany of a smartphone, tablet computer, eyeglass and headset. The devicemay be placed in a first location with reference to the image to readthe augmented reality trigger art, initiate the augmented realityexperience, locate the Data Code parts, combine the Data Code parts andread the Data Code without moving from the first location.

In a sixth aspect of the present disclosure a method of initiating anaugmented reality experience and a Data Code reading with a single scanperformed by a device is provided. A method according to this aspect mayinclude the steps of placing a device in a first location, performing ascan of an image to read an augmented reality trigger and a Data Codewithin the image, initiating an augmented reality experience in responseto the augmented reality trigger, and processing information containedin the Data Code. A location information of the Data Code within theimage may be generated by the augmented reality trigger such that thedevice may locate the Data Code during the scan from the first location.

The present invention implements a new system and defined herein as aQuick Art Response Code (“QAR Code”) system where an augmented realitytrigger is used to locate, read and/or process Data Code embedded withinan image.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the subject matter of the presentinvention and the various advantages thereof can be realized byreference to the following detailed description, in which reference ismade to the following accompanying drawings:

FIG. 1 is a flow chart describing steps for locating Data Code in animage using an augmented reality trigger according to one embodiment ofthe present invention;

FIG. 2 is a flow chart describing steps for locating Data Code in animage using an augmented reality trigger according to another embodimentof the present invention;

FIG. 3A is schematic view of a method of breaking down Data Codeaccording to an embodiment of the present invention;

FIG. 3B is a schematic view of various uniquely shaped Data Codepatterns used in conjunction with the steps described the flow chart ofFIG. 2 ;

FIG. 4 is a schematic view showing steps for locating Data Code using anaugmented reality identifier according to an embodiment of the presentinvention;

FIG. 5 is a schematic view showing steps for locating Data Code using anaugmented reality trigger according to another embodiment of the presentinvention;

FIG. 6 is a QAR Code-enabled image containing an augmented realitytrigger and Data Code according to an embodiment of the presentinvention;

FIG. 7 is a flow chart describing steps for locating and processing DataCode in an image using an augmented reality trigger according to anembodiment of the present invention; and

FIG. 8 is schematic view showing an augmented reality experience andData Code located within a QAR Code-enabled image according to anembodiment of the present invention.

DETAILED DESCRIPTION

Disclosed herein are methods of using a QAR Code system in which anaugmented reality trigger (“AR trigger”) is implemented to locate DataCode in an image. Various methods to breakdown and locate the Data Codewithin an image using the AR trigger are described herein. AnyAR-enabled device using image recognition can execute a QAR code byinitiating the AR trigger to locate and read the Data Code placed in theimage. As used herein, the term linear barcodes can include anyone-dimensional code, and matrix barcodes can include anytwo-dimensional code. The term “augmented reality trigger” can includeany initiator or trigger image configured to trigger an augmentedreality experience. The terms “augmented reality art trigger” and“augmented reality trigger” will be used interchangeably and as such,unless otherwise stated, the explicit use of either term is inclusive ofthe other term. While the methods and systems of the present disclosuretypically refer to, or provide examples of QR codes and data matrixcodes, the methods and system of the present disclosure can be used withany linear or matrix barcode.

Referring to FIG. 1 , there is shown a flow chart 100 describing use ofa QAR Code system including steps for locating a Data Code in an imageusing an AR trigger according to an embodiment of the presentdisclosure. As more fully explained below, the image is QAR Code-enabledand can be a picture, design, logo, symbol, icon, graphic mark, etc. AData Code containing the required data is created using standard libraryfunctions known in the art in step 102. The Data Code can be a linearbarcode or a matrix barcode. For example, the Data Code can be a QRcode, data matrix code, a postal code or any other standard code. Inother embodiments, Data Codes can be customized by shape, size and colorto blend into the image to minimize detection by a viewer whileretaining the aesthetics of the image. Various customized uniquelyshaped Data Codes are illustrated in FIG. 3B, which include a circularData Code 140, a triangular Data Code 142 and a star-shaped Data Code144. Customized Data Codes can be appropriately selected and placedwithin an image to enhance the image visibility and aesthetics.

The Data Code is broken down into separate parts in step 104. As shownin FIG. 3A, a Data Code 120 containing a data string is broken down intoData Code parts 122, 124, 126, 128 and 130. Each of the Data Code partsinclude data from Data Code 120. For example, Data Code part 122includes 3 of the 15-chraracter Data Code 120. As shown in FIG. 3A, eachof the Data Code parts can be individual Data Codes—i.e., a data matrixthat can be scanned and read by a reading device such as a smartphone ora table computer. In other embodiments, the Data Code parts can becomponents of a single Data Code—i.e., the Data Code parts can bevirtually assembled into a single seral code in order to read the DataCode. Breaking down the Data Code into parts allows for greater storageof data the image without impacting the aesthetics of the image—i.e.,improved concealment of the Data Code. For example, a Data Matrix Codewith a module size of 144×144 typically stores 2335 alphanumericcharacters. However, the 144×144 Data Matrix Code will occupy a largeportion of the image and impact image aesthetics. Using the QAR Codesystem and associated method disclosed herein, multiple Data Matrixcodes having module sizes of 88 x 88 with each Data Matrix Codecontaining 862 alphanumeric characters can be strategically concealedwithin the image. Thus, greater information with minimal impact to imagevisualization can be achieved.

Following step 104, an AR trigger art is created and placed in the imagein a step 106. For example, FIGS. 4 and 5 illustrate an AR trigger art133 in a QAR Code-enabled image 132. The AR trigger art 133 can beblended into the image to minimize visual impact and maintain the imageaesthetics. For example, the letter “V,” which is an integral part ofimage 132, is used as the AR trigger art in FIGS. 4 and 5 . Similarly,any other image characters, or markings can be conveniently used tofunction as the AR trigger art. FIG. 6 illustrates another example of anAR trigger art 302 in an image 300. As shown in FIG. 6 , the letter “V”serves as part of a logo and the AR trigger in image 300. The AR triggeror marker that can be read by an AR-enable device such as a smartphoneor table computer to initiate the AR experience. The AR trigger art canbe sized, shaped and/or colored to blend with the image to enhance imagevisibility and aesthetics.

Following step 106, Data Code parts are located on the image in asubsequent step 108. As shown in FIG. 4 , Data Code parts 136 arestrategically located on the image to preserve image visibility andaesthetics. Multiple Data Code parts can be conveniently concealedwithin the natural attributes of the image as shown in FIGS. 4 and 5 .

Following step 108, an AR digital identifier is generated for the ARtrigger art created in step 106. FIGS. 4 and 5 illustrate examples of anAR digital identifier 134. The digital identifier can be any imagedetection feature used by the AR experience to detect the target image.For example, FIG. 4 shows an AR digital identifier 134 which includes aplurality of position markers located throughout image 132. The positionmaker locations are created in reference to the Data Code partpositioned in step 108. Once the location of the position makers or thegrid is known by the AR-enabled device, the location of the Data Codeparts located in reference to the position markers and the grid can bedetermined by the AR-enabled device in a step 112. The locationinformation of each position marker is stored in the memory of theAR-enabled device such as a tablet computer or smartphone. In anotherembodiment, the location information can be stored on a cloud-basedremote storage system which can be accessed by the AR-enabled device.This allows the AR-enabled scanning/reading device to locate thepositions of each position marker once the AR experience is triggeredthrough the AR trigger art.

FIG. 5 illustrates another example of AR digital identifier 134 whichincludes a grid pattern. Rows and columns of AR digital identifier 134provide a framework to reference any position on image 132. For example,AR digital identifier is generated with reference to Data Code partslocated in the image. Each Data Code part can now be identified andlocated based on the grid reference. For example, a specific Data Codepart location can be identified as a specific row and column of the gridpattern. This location information is stored and communicated to theAR-enabled device to readily locate and read the Data Code part. Thus,locating, reading and encoding the Data Code parts is performed withoutthe need for a search algorithm to scan and detect Data Codes in theimage. Consequently, the Data Code part location information reduces theneed for processing resources and time to read Data Codes in the image.While position markers (FIG. 4 ) and a grid (FIG. 5 ) are describedhere, other embodiments can have various other patterns or referencepoints distributed throughout the image to provide a reference frameworkof the image. While FIGS. 4 and 5 illustrate AR digital identifiers aspositions markers and a grid pattern respectively, any other AR digitalidentifier such as color-contrasting patterns, digital identifiers, etc.can be used in other embodiments.

FIG. 2 shows a flow chart 200 describing steps for locating a Data Codein an image using an AR trigger according to another embodiment of thepresent disclosure. Flow chart 200 is similar to flow chart 100, andtherefore like steps are referred to with similar numerals within the200-series of numbers. For example, flow chart 200 includes a step 202to generate Data Code containing required data using standard libraryfunctions known in the art. However, flow chart 200 describes stepsinvolving a custom-shaped Data Code 146 depicted in FIG. 3B. Thecustom-shaped Data Code facilitates easier concealment of the Data Codewithin the image to enhance image visualization. The Data Code parts ofthe custom-shaped Data Code can be broken down to match various featuresof the image to enhance image visibility and aesthetics.

FIG. 6 shows a QAR Code-enabled image 300 according to an embodiment ofthe present disclosure. Image 300 includes a Data Code 304 and an ARtrigger art 302. In this embodiment, a single Data Code 304 isstrategically located on image 300. An AR trigger identifier is notnecessary to locate the Data Code in this embodiment. Thus, an AR-enablescanning device such as a smartphone or a table computer can initiatethe AR experience via AR trigger art 302 and extract information fromthe Data Code 304 with a single scan of image 300.

Referring to FIG. 7 , there is shown a flow chart 400 describing stepsfor reading a Data Code in a QAR Code-enabled image using AR trigger artaccording to an embodiment of the present disclosure. An AR-enableddevice such as smartphone, tablet computer, eyeglass, headset etc. isused to read the AR trigger art in a step 402. Once the AR trigger artis recognized by the AR-enabled device in step 404, the AR experience islaunched in a step 406. As shown in FIG. 8 , a product 500 whichincludes an image 502 with an AR trigger art is read by a smartphone totrigger the AR experience 506.

Following step 406, location of the Data Code or Data Code parts isdetermined by referencing the AR digital identifier in step 408. As morefully described above, the AR digital identifier can generate positionmarkers or a grid to map the image. The Data Code parts can then belocated by the smartphone, and reconstructed based on the locationinformation stored in the AR-enabled device in a step 410. Thereconstructed Data Code can now be read to extract the Data Codeinformation 512 as shown in FIG. 8 . Thus, a single reading or scan ofimage 502 using an AR-enabled device located in a single position issufficient to generate the AR experience, locate and read the Data Codeembedded in image 502—i.e., no translation of the AR-enabled device isnecessary to perform these steps. A single reading to trigger the ARexperience and read the Data Code will save time because multiplereadings are not required. A single reading will also optimize computingresources because Data Code locations are stored in the imageinformation available to the AR-enabled device thus requiring scanningand reading of the specific Data Code locations. Using an AR experienceto locate and read various code types in an image allows for quickdetection by the reading/scanning device. This will reducing processingresources and time to decode the code. Large data sets can be stored inthe Data Code without impacting image quality.

Another aspect of the present disclosure is a QAR Code-enabled imagecontaining an augmented reality trigger and one or more Data Codes asshown in FIG. 8 . Image 502 includes augmented reality trigger 514 andthe Data Code comprising of a plurality of Data Code parts 516. Theaugmented reality trigger may be configured to initiate an augmentedreality experience. As shown here, image 502 is a label containingproduct labeling. In other embodiments, the image can be a design, logo,picture or any other representation. The augmented reality trigger 514is part of image 502 and is configured to blend within the image tominimize visual identification of the augmented reality trigger. Theaugmented reality trigger sub image can be sized, shaped and/or coloredto blend into the image. The plurality of Data Code parts are also subimages configured to blend within the image to minimize visualidentification of the plurality of Data Code parts as best shown in FIG.8 .

Combining various code types allows for quick detection and largeinformation storage without impacting image quality. For example, theaugmented reality experience can include general information about aproduct line, and the Data Code can include product-specific informationfor each product from the product line. Thus, each product label caninclude a generic AR experience common to all product labels, andlabel-specific Data Code data that provides data regarding each labelassociated with a specific product. For example, a label created for awine bottle using this method can include an AR experience thatdescribes information of the winery and the type of wine, whereas theData Code can provide specific information regarding each bottle such asbottling date, price, etc.

Initiating an augmented reality experience and reading Data Codecurrently require separate applications with separate scans beingrequired for each of these experiences. In one embodiment of the presentinvention, the QAR Code system improves upon the prior art through animage that includes an augmented reality trigger and Data Code. By doingso, the QAR Code system enables initiation of the augmented realityexperience and the Data Code reading, within a single app, and with justa single scan, allowing for the experience of the augmented reality andthe Data Code to occur simultaneously or sequentially.

Furthermore, although the invention disclosed herein has been describedwith reference to particular features, it is to be understood that thesefeatures are merely illustrative of the principles and applications ofthe present invention. It is therefore to be understood that numerousmodifications, including changes sequence of the method steps describedherein, may be made to the illustrative embodiments and that otherarrangements may be devised without departing from the spirit and scopeof the present invention. In this regard, the present inventionencompasses numerous additional features in addition to those specificfeatures set forth in the paragraphs below. Moreover, the foregoingdisclosure should be taken by way of illustration rather than by way oflimitation as the present invention is defined in the examples of thenumbered paragraphs, which describe features in accordance with variousembodiments of the invention, set forth in the claims below.

1. An image with an augmented reality trigger to read a Data Code, theimage comprising: an augmented reality trigger located in a firstlocation within an image, the augmented reality trigger configured toinitiate an augmented reality experience, the first location defining acontinuous area within the image, and a Data Code comprising a pluralityof Data Code portions, each Data Code portions arranged in a pluralityof second locations within the image, the plurality of second locationsbeing located outside the first location, wherein the augmented realitytrigger includes location information to locate each of the plurality ofsecond locations and combine the Data Code portions to a unified DataCode.
 2. The image of claim 1, wherein the augmented reality experienceis stored in a data set including location information to locate each ofthe Data Code portions.
 3. The image of claim 2, wherein the data setincludes information to combine the plurality of Data Code portions. 4.The image of claim 1, wherein the Data Code comprises a linear code. 5.The image of claim 1, wherein the Data Code comprises a matrix code. 6.The image of claim 1, wherein the Data Code comprises a QR code.
 7. Theimage of claim 1, wherein each of the Data Code portions are componentsof a composite Data Code.
 8. The image of claim 1, wherein each of theData Code portions comprise an independent Data Code.
 9. The image ofclaim 1, wherein the Data Code is arranged to blend into the image tominimize visual identification of the Data Code by a viewer.
 10. Theimage of claim 1, wherein the augmented reality trigger comprises gridpattern information used to locate the Data Code.
 11. The image of claim1, further comprises a device configured to be placed in a firstlocation to locate the augmented reality trigger, initiate the augmentedreality experience, locate each of the Data Code portions, combine theData Code portions, and process the Data Code in the first location. 12.An augmented reality experience system comprising: an image with anaugmented reality trigger located in a first location therein, theaugmented reality trigger configured to initiate an augmented realityexperience, the first location defining a continuous area within theimage, a Data Code comprising a plurality of Data Code portions, eachData Code portions arranged in a plurality of second locations withinthe image, the plurality of second locations being located outside thefirst location, and a device configured to be placed in a first locationto locate the augmented reality trigger, initiate the augmented realityexperience, locate each of the Data Code portions from a locationinformation of the augmented reality trigger, combine the Data Codeportions, and process the Data Code in the first location.
 13. Theaugmented reality experience system of claim 12, wherein the augmentedreality experience is stored in a data set including locationinformation to locate each of the Data Code portions.
 14. The augmentedreality experience system of claim 13, wherein the data set includesinformation to combine the plurality of Data Code portions.
 15. Theaugmented reality experience system of claim 12, wherein the Data Codecomprises a linear code.
 16. The augmented reality experience system ofclaim 12, wherein the Data Code comprises a matrix code.
 17. Theaugmented reality experience system of claim 12, wherein the Data Codecomprises a QR code.
 18. The augmented reality experience system ofclaim 12, wherein each of the Data Code portions are components of acomposite Data Code. (new) The augmented reality experience system ofclaim 12, wherein each of the Data Code portions comprise an independentData Code.
 20. The augmented reality experience system of claim 12,wherein the Data Code is arranged to blend into the image to minimizevisual identification of the Data Code by a viewer.